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(57)Abstract: 

PROBLEM TO BE SOLVED: To provide a device for extracting an object in a 
moving picture that can generate correct alpha data without overwriting alpha 
data of a frame by which extraction of an object has already been successful. 
SOLUTION: The device for extracting an object in a moving picture is provided 
with an alpha data preparing section 7 that prepares alpha data representing an 
object area in a moving picture by each frame, a storage section 3 that stores 
the prepared alpha data, a mode setting section 6 that sets an overwrite 
permission mode or an overwrite disapproval mode by each frame as to the 
alpha data stored in the storage section 3, and a control section 8 that 



discriminates whether the mode set by the mode setting section 6 as to a current 
processing frame is the overwrite permission mode or the overwrite disapproval 
mode, allows the alpha data preparation section 7 to newly generate alpha data 
of the current processing frame only when the mode is the overwrite permission 
mode and overwrites the newly prepared alpha data on the alpha data of the 
same frame as those of the current processing frame stored in the storage 
section 3 as its control. 
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* NOTICES* 

JPO and NCIPI are, not responsible for any 
damages caused by the use of this translation. 

1. This document has been translated by computer. So the translation may not 
reflect the original precisely. 

2. **** shows the word which can not be translated. 
3.ln the drawings, any words are not translated. 

CLAIMS 
[Claim(s)] 

[Claim 1] In the object extract approach in a dynamic image of performing the 
object extract which carries out sequential generation of the alpha data showing 
the body field in a dynamic image for every frame of this dynamic image The 
alpha-data generation step which generates said alpha data for said every frame, 
The mode setting step which sets up the mode of either overwrite authorization 
mode or overwrite disapproval mode, respectively about the alpha data for said 
every frame generated at said alpha-data generation step, Jt has the mode 
judging step the mode set up at said mode setting step about the present 



processing- frame judges either overwrite -authorization mode or overwrite 
disapproval mode to be. When the mode judged at said mode judging step is 
overwrite authorization mode The object extract approach in a dynamic image 
characterized by overwriting on the alpha data with which the alpha data of said 
present processing frame were newly generated at said alpha-data generation 
step, and the same frame as the present processing frame was already 
generated. 

[Claim 2] It is the object extract approach in a dynamic image according to claim 
1 characterized by advancing processing or ending processing, without 
generating alpha data new about said present processing frame when the mode 
judged at said mode judging step is overwrite disapproval mode. 
[Claim 3] Said mode-setting step is the object extract approach according to 
claim 1 in a dynamic image of carrying out carrying out a setup in said overwrite 
authorization mode or overwrite disapproval mode as the description, by a user 
specifying the section in overwrite authorization mode or overwrite disapproval 
mode on the cine-mode-display lane which displays the image of two or more 
frames which constitute said dynamic image in order of a frame, or specifying an 
overwrite authorization initiation frame, an overwrite authorization termination 
frame or an overwrite disapproval initiation frame, and an overwrite disapproval 
initiation frame. 



[Claim 4] The object extract approach in a dynamic image characterized by to 
have the alpha-data generation step which generates two or more alpha data for 
every frame using two or more mutually different parameters, respectively in the 
object extract approach in a dynamic image of performing the object extract 
which carries out sequential generation of the alpha data showing the body field 
in a dynamic image for every frame of this dynamic image, and the selection 
step which choose one of two or more alpha data generated at said alpha-data 
generation step for every frame of said. 

[Claim 5] The object generation method in a dynamic image characterized by to 
have the motion parameter input step which inputs the motion parameter which 
shows at least one motion of the body in said dynamic image, a background, and 
the whole dynamic image in the object extract approach in a dynamic image of 
performing the object extract which carries out sequential generation of the 
alpha data showing the body field in a dynamic image for every frame of this 
dynamic image, and the alpha-data generation step which generate alpha data 
for every frame of said using said inputted motion parameter. 
[Claim 6] In the object extractor in a dynamic image which performs the object 
extract which carries out sequential generation of the alpha data showing the 
body field in a dynamic image for every frame of this dynamic image An 
alpha-data generation means to generate said alpha data for said every frame, A 



storage means to memorize the alpha data generated with said alpha-data 
generation means, A mode setting means to set up the mode of either overwrite v 
authorization mode or overwrite disapproval mode about the alpha data 
memorized by said storage means for said every frame, The mode set up with 
said mode setting means about the present processing frame judges either 
overwrite authorization mode or overwrite disapproval mode. The control means 
which performs control which overwrites on the alpha data of the same frame as 
the present processing frame with which only the time of overwrite authorization 
mode makes said alpha-data generation means newly generate the alpha data 
of said present processing frame, and is remembered to be by said storage 
means The object extractor in a dynamic image characterized by having. 
[Claim 7] The object extractor in a dynamic image characterized by to have an 
alpha-data generation means generate two or more alpha data for every frame 
using two or more mutually different parameters in the object extractor in a 
dynamic image which performs the object extract which carries out sequential 
generation of the alpha data showing the body field in a dynamic image for every 
frame of this dynamic image, respectively, and a selection means choose one of 
two or more alpha data generated at said alpha-data generation step for every 
frame of said. 

[Claim 8] The object generation equipment in a dynamic image characterized by 



to have a motion parameter input means input the motion parameter which 
shows at least one motion of the body in said dynamic image, a background, and 
the whole dynamic image in the object extract approach in a dynamic image of 
performing the object extract which carries out sequential generation of the 
alpha data showing the body field in a dynamic image for every frame of this 
dynamic image, and an alpha-data generation means generate alpha data for 
every frame of said using said inputted motion parameter. 



DETAILED DESCRIPTION 

[Detailed Description of the Invention] 
[0001] 

[Field of the Invention] This invention relates to the approach and equipment 
which extract the object in a dynamic image by generating the alpha data 
showing the body field in a dynamic image for every frame. 
[0002] 

[Description of the Prior Art] It is useful to carry out automatic extracting of the 
body in a dynamic image (object) in order to perform processing which edits and 
processes a dynamic image for every body, or transposes the background of a 



- dynamic image to another background. ........ 

[0003] Generally, in order to express the body field In a dynamic image, an - 
image with a mutually different pixel value (alpha value) is combined with a 
subject-copy image, and is prepared in a body field and a background region. 
The processing which generates alpha data, and a call and these alpha data for 

the data of the image which consists of such alpha values for every frame is 

i 

called the object extract in a dynamic image. Alpha data may be data other than 
subject-copy image data, or they may be constituted so that it may be contained 
in subject-copy image data. In the case of the latter, the format which sets up A 
value (alpha value) for every pixel in addition to an R value, G value, and B value 
is used in many cases. 

[0004] There is the chroma-key method as an object extraction method used 
conventionally. By the chroma-key method, the color registered beforehand is 
made into a background color, and a background region and the field of the pixel 
of the other color are judged for the field of the pixel which has a background 
color and a near color in image data, respectively to be a body field. The 
image-processing software the "premium" of Adobe is equipped with the function 
to extract a body from a dynamic image by the chroma-key method. 
[0005] When performing a body extract using this function, the image of a certain 
frame is displayed first and a background color is registered by a user clicking 



the pixel on that background. Next, after setting up the threshold forjudging that 
it is a background, automatic extracting of the body is carried out for every frame 

t 

from the whole dynamic-image sequence using this threshold and a background 
color. However, by the chroma-key method, when many colors exist in the 
background of a processing-object image or the same color as a background is 
in a body, there is a problem that a body cannot be extracted correctly. 
[0006] In order to cancel the fault of the chroma-key method this the bottom, as 
an approach of extracting the body on the background of arbitration this 
invention persons - "inter-frame -- body extract [ of the dynamic image which 
used difference and block matching together]" (triple cedars, Ida, and Watanabe 
-) The 5th time Image sensing symposium There is an approach called the 
hybrid method which was indicated by lecture collected works, C-4, PP.61 -66, 
and June 1999, and which uses together a finite difference method and a block 
matching method. With this hybrid method, the alpha data of the body which a 
user wants to extract first in the frame of the beginning of a dynamic image are 
set up by manual actuation. Henceforth [ the 2nd frame ], alpha data are 
generated automatically, pursuing a motion of a body etc. based on the alpha 
data of the first set-up frame, that time - the retrieval range of the motion vector 
for motion detection, and inter-frame - a user sets up extract parameters, such 
as a threshold for the judgment of the body set up to difference, or a background, 



-by manual actuation. 
[0007] In the body extract using a hybrid method, in the first frame, an extract • 
parameter is set up like the above-mentioned premium, and, henceforth [ the 
2nd frame ], how to perform a body extract using the same parameter can be 
considered. Even if a body extract can do a certain frame correctly, it may be 

able to stop being able to perform a body extract correctly with the frame after it 

i 

in this approach. It is because an extract parameter required for a body extract 
changes with progress of a frame by the image in which a hybrid method has a 
background so that the target arbitration. 

[0008] For this reason, it is necessary to change an extract parameter about the 
frame which failed in the extract, to redo an extract, and to overwrite alpha data 
by the approach of performing a body extract using a motion of the extract result 
of a front frame like a hybrid method and a body. However, overwrite may be 
made with the alpha data with which the frame on which it did not necessarily 
restrict that a right extract was performed, but the body extract was already 
correctly performed about the frame which failed in the body extract with a 
certain extract parameter even if another extract parameter performed the body 
extract failed in the extract. In the body extraction method using the alpha data of 
a frame other than especially the present processing frame, and a motion of a 
body, even if it is the same extract parameter, the body extract result in the 



present processing frame will change with the situations of the alpha data of 
another frame. Therefore, even if it only carries out storage maintenance of the 
extract parameter, the already obtained alpha data cannot necessarily be 
reproduced. 
[0009] 

[Problem(s) to be Solved by the Invention] Alpha data are generated by using 
the 2nd extract parameter or subsequent ones set up with the first frame, and 
performing a body extract, as mentioned above. With the conventional object 
extract technique in a dynamic image which overwrites on the alpha data which 
reextracted after changing an extract parameter, when a body extract goes 
wrong, and were already obtained There was a case where the frame with which 
the body extract was already made correctly was overwritten with the alpha data 
which failed in the extract, and was lost. 

[0010] This invention aims at offering the object extract approach in a dynamic 
image and equipment which extract the body in a dynamic image certainly and 
can generate alpha data. 

[0011] The more concrete purpose of this invention is to offer the object extract 
approach in a dynamic image and equipment which can generate right alpha 
data, without overwriting the alpha data of the frame which already succeeded in 
the body extract, when a hybrid method is used. 



[0012] 

[Means for Solving the Problem] In order to solve the above-mentioned technical 
problem, in this invention, the alpha data showing the body field in a dynamic 
image are generated for every frame of a dynamic image, and the mode of either 
overwrite authorization mode or overwrite disapproval mode is set up about 

these generated alpha data for every frame, respectively. It is judged any in 

i 

overwrite authorization mode or overwrite disapproval mode the mode set up 
about the present processing frame is, and when it is in overwrite authorization 
mode, the alpha data of the present processing frame are newly generated. And 
these newly generated alpha data are overwritten on the alpha data with which 
the same frame as the present processing frame was already generated. When 
the judged mode is overwrite disapproval mode, without generating alpha data 
new about the present processing frame, processing is advanced or processing 
is completed. 

[0013] By doing in this way, alpha data can be generated for every frame, 
without overwriting the alpha data of the frame which already succeeded in the 
body extract. 

[0014] moreover, in this invention, two or more alpha data generate for every 
frame using two or more mutually different parameters, respectively ~ having -- 
every frame - ******** - one of two or more alpha data generated based on the 



parameter-is chosen. — 

[0015] Furthermore, in this invention, the motion parameter which shows at least 
one motion of the body in a dynamic image, a background, and the whole 
dynamic image is inputted, and alpha data are generated for every frame using 
this motion parameter. 
[0016] 

[Embodiment of the Invention] Hereafter, the gestalt of operation of this invention 
is explained with reference to a drawing. 

(The whole object extractor configuration in a dynamic image) Drawing 1 shows 
the configuration of the object extractor in a dynamic image concerning 1 
operation gestalt of this invention. It realizes using a personal computer and this 
object extractor in a dynamic image consists of displays 4, such as the storage 
sections 3, such as the input section 1 which roughly divides and contains a 
keyboard and a pointing device like a mouse, CPU2, and a hard disk drive unit, 
memory, and a liquid crystal display, and a CRT monitor. 

[0017] Moreover, in drawing 1 , the alpha-data setting section 5, the mode 
setting section 6, the alpha-data generation section 7, and a control section 8 
are formed as an element which realizes the object extractor in a dynamic image, 
the function of the alpha-data setting section 5 and the mode setting section 6 is 
realized by the input section 1 , and the function of the alpha-data generation 



section 7 and a control section 8 is realized by CPU2: 

[0018] In the alpha-data setting section 5, the alpha data of the frame of a 
dynamic image, for example, the beginning, are set up by manual actuation by 
the user using this equipment. The set-up alpha data are written in the storage 
section 3 under control by the control section 8. In the mode setting section 6, it 

is manual actuation by the user, or the mode of either overwrite authorization 

i 

mode, and overwrite the mode in which a permission is not granted is 
automatically set up to a control section 8 for every frame of a dynamic image. In 
the alpha-data generation section 7, the alpha data of the present processing 
frame are generated using the alpha data of the processed frame memorized by 
the storage section 3 under control by the control section 8. A control section 8 
performs control of the alpha-data generation section 7, and the writing / 
read-out control of the storage section 3. 

[0019] (display screen for the object extract in a dynamic image) Drawing 2 
shows the example of the display screen in the display 4 at the time of the object 
extract in a dynamic image. As shown in this drawing, the cine-mode-display 
lane 11, a frame pointer 12, the image display window 13, the display frame 
change carbon buttons 14, the alpha-data data setup key 15, the fitting carbon 
button 16, the body extract carbon button 17, and the mode setting lane 18 are 
arranged in the display screen 10. 



[0020] The reduced display of the image of each frame which constitutes a 
dynamic image in the cine-mode-display lane 1 1 is carried out to the order of a 
frame. When there are many frame numbers, it thins out suitably and is 
displayed. The image of the frame of the location to which it points with a frame 
pointer 12 among the cine-mode-display lanes 11 is greatly displayed on the 
image display window 13. By clicking either of the display frame change carbon 
buttons 14, actuation of "animation playback", "a playback halt", "moving one 
frame ago", "moving one frame after", "moving to the first frame", and "moving to 
the last frame" can be performed on the image display window 13, and a frame 
pointer 12 also moves automatically according to it. 

[0021] By dragging a frame pointer 12 to right and left, the frame of the image 
displayed on the image display window 13 changes. Then, a body pen or a 
background pen is chosen by clicking the alpha-data setup key 15 for performing 
two kinds of input changes, a body input and a background input, where the 
image of the first frame (frame at the left end of the cine-mode-display lane 1 1) is 
first displayed on the image display window 13, and a body field and a 
background region are applied in the image display window 13 with the body pen 
or a background pen. This is equivalent to setting actuation in the alpha-data 
setting section 5 of drawing 1 , and, thereby, rough alpha data are set up. 
[0022] Next, fitting of the profile of alpha data is carried out to the profile of the 



body in a dynamic image for example, with a self-similarity model by clicking the 
fitting carbon button 16. Then, the alpha data of the frame after it are generated 
by the hybrid method by clicking the body extract carbon button 17. Based on 
these generated alpha data, a body extract image is displayed in the image 
display window 13. This body extract image shall take the gestalt which smeared 

away a part for a background by the predetermined color, or was smeared away 

i 

translucent by the predetermined color. At this time, the image displayed on the 
cine-mode-display lane 11 is also replaced with the original dynamic image 
sequentially from the left, it changes to a body extract image, and a frame 
pointer 12 also moves to right-hand side according to it. A body extract will be 
ended if a body extract image reaches the last frame. 

[0023] In this phase, since the body extract was not successful with all frames, 
using a frame pointer 12 etc., a user displays a body extract image and checks a 
result. And it specifies by dragging from the display of this body extract image 
with a mouse on the mode setting lane 18 to the frame of the section when the 
body extract was successful etc., as a slash shows, overwrite disapproval mode 
is set up, and overwrite authorization mode is set up to the frame of the section 
when the other body extract was not successful. This is equivalent to actuation 
in the mode setting section 6 of drawing 1 . 

[0024] By the approaches of generating the alpha data of the present processing 



frame using the alpha data of a processed frame, such as a hybrid method, once 
a body extract goes wrong, it also influences subsequent frames and there is an 
inclination for a body extract to go wrong continuously. Therefore, as the frame 
which succeeds in a body extract, and the frame which fails in an extract were 
shown at the section in the overwrite disapproval mode of drawing 2 , and 
overwrite authorization mode, respectively, all continue in many cases. 
[0025] Next, a user displays the first frame which failed in the body extract on the 
image display window 13, and adds correction using the body pen or 
background pen chosen by the alpha-data setup key 15, and the fitting carbon 
button 16. Then, by clicking the body extract carbon button 17 again, the alpha 
data of subsequent frames are generated automatically and the alpha data of 
the frame in overwrite authorization mode are overwritten on the storage section 
3. In this case, since the first frame which failed in the body extract will be 
corrected, subsequent frames can perform a body extract correctly by the high 
probability. 

[0026] In addition, in order to mitigate the manual actuation at the time of setting 
up overwrite disapproval mode, the approach of setting automatically the frame 
presumed to have succeeded in the body extract as overwrite disapproval mode 
may be used. For example, about the frame that the level difference of the pixel 
value of the both sides of an objective border line with little effect of a motion with 



the smairerror at the time of the motion vector detection in a hybrid method is 
large, it considers that the body extract was successful and is automatically set 
as overwrite disapproval mode. The setting result checks whether it is the right 
from the display of the mode setting lane 18, and a user will correct suitably, if it 
has mistaken. 

[0027] (procedure of the object extract in a dynamic image) Next, the various 

i 

procedure of the object extract in a dynamic image in this operation gestalt is 
explained using the flow chart shown in drawing 3 - drawing 6 . 
[0028] The alpha data of the frame of the beginning of a dynamic image are set 
up by the alpha-data setting section 5, and drawing 3 shows the processing after 
the alpha data of all the frames of the processing object of a dynamic image 
were further generated in the alpha-data generation section 7 and the storage 
section 4 memorized. First, either mode of overwrite authorization mode or 
overwrite disapproval mode is set up for every frame of a dynamic image (step 
S11). The performance of alpha data is checked for every frame from the body 
extract image displayed using alpha data on the image display window 13 of the 
display screen 10 which the user showed to drawing 2 , and, specifically, it is set 
as overwrite authorization mode with the frame which is not so in overwrite 
disapproval mode with the frame with which the body extract is made correctly. 
The concrete technique of this mode setting is described in detail later. 



[0029] As the approach of other mode setting in step S11, as mentioned above, 
about the frame. that the level difference of the pixel value of the both sides of an 
objective border line with little effect of a motion with the small error at the time of 
the motion vector detection in a hybrid method is large, it may consider as 
overwrite disapproval mode, and the other frame may perform mode setting 
automatically so that it may consider as overwrite authorization mode. 
[0030] Next, when it is judged whether it is overwrite authorization mode (step 
S12) and the frame of the beginning of a dynamic image is in overwrite 
authorization mode in a control section 8, the alpha data of an applicable frame 
are generated in the alpha-data generation section 7 (step S13). When it 
progresses to step S14 when it is not in overwrite authorization mode in step 
S12 (i.e., when it is in overwrite disapproval mode), and it is judged whether 
processing of all frames was completed and the unsettled frame remains, 
processing of steps S12-S 14 is repeated by using the following frame as the 
present processing frame. Thereby, the 2nd frame or subsequent ones is 
processed sequentially. When judged with the last frame at step S14, the object 
extract processing in a dynamic image is ended. 

[0031] The alpha data of the frame of the beginning of a dynamic image are set 
up by the alpha-data setting section 5 like drawing 3 , and drawing 4 shows the 
processing after the alpha data of all the frames of the processing object of a 



dynamic image were further generated in the alpha-data generation section 7 
and the storage section 4 memorized. Although mode-setting processing of step 
S21, overwrite authorization / disapproval judging processing of step S22, 
alpha-data generation processing of step S23, and all frame termination judging 
processings of step S24 are fundamentally the same, when it judges with 

overwrite disapproval in step S22 with the case of drawing 3 , they do not 

i 

advance processing to the following frame, but even if the frame remains, the 
point which ends the object extract processing in a dynamic image immediately 
differs from drawing 3 . 

[0032] According to the procedure of this drawing 4 , by making only the section 
performing a body extract into overwrite authorization mode, when performing a 
body extract only from the frame of a certain section, when the termination of the 
section is reached, the object extract processing in a dynamic image can be 
ended automatically. 

[0033] Drawing 5 shows alpha-data generation processing in the alpha-data 
generation section 7. First, two or more alpha data are generated by coincidence 
for every frame using two or more different extract parameters defined 
beforehand (step S31). Next, when it is judged whether alpha-data generation 
processing was completed about all frames (step S32) and the alpha-data 
non-generated frame remains, processing of step S31 is repeated by using the 



following-frame as the present processing -frame. When judged with the last 
frame at step S32, finally the alpha data chosen one [ at a time ] are used for 
future processings by the user as an output of the alpha-data generation section 
7, for example out of the alpha data generated every for every frame. [ two or 
more ] 

[0034] Drawing 6 shows other alpha-data generation processings in the 
alpha-data generation section 7. First, the motion parameter used for a body 
extract is set up (step S41). A motion parameter is calculated from the result as 
which the user inputted at least a body, a background, the direction of a motion 
of the whole screen, and one side of magnitude on the display screen. The 
concrete setting approach of this motion parameter is explained in detail later. 
[0035] Next, alpha data are generated using the motion parameter set up at step 
S41 (step S42). And when it is judged whether alpha-data generation processing 
of all frames was completed (step S43) and the alpha-data non-generated frame 
remains, set-up generation of alpha data move and using the parameter is 
performed about all frames by repeating processing of step S42 by using the 
following frame as the present processing frame. 

[0036] (alpha-data setting section 5) Next, the concrete setting approach in the 
alpha-data setting section 5 is explained. While the image of the first frame is 
displayed, for example on the image display window 13 of the display screen 10 



and a user looks at this image as the concrete technique of an alpha-data setup, 
the method of setting up alpha data, using continuous tone and its 
smeared-away field as a body field for the body of the request in an image using 
the pointer of a mouse etc. is the easiest. 

[0037] If it is translucent and the color smeared away in the smeared-away field 

at that time is displayed, since the image of the body in the smeared-away field 

i 

can be checked, there is an advantage that the alpha data of a desired body field 
are certainly generable. Even if it does not color a body field but colors a 

4 

background region, an objective image can be recognized well. 
[0038] Moreover, when the actuation correctly smeared away along with an 
objective profile is complicated fitting (Ida and triple cedars -) of the border line 
according [ this invention persons ] to the "self-similar method after performing 
rough continuous tone The 5th time Image sensing symposium If fitting [ the 
profile of alpha data / an objective profile ] using the self-similarity model method 
proposed by lecture collected works, C-15, PP.1 15-120, and June 1999" 
automatically Alpha data can be set up by little time and effort. 
[0039] Display a border line with a control point (O mark shows), and it is made 
to move by dragging these control points with the pointer of a mouse as other 
setting approaches of alpha data, as shown in drawing 7 (a), and if it is made to 
make a border line transform so that a desired body may be approximated as 



-shown in- drawing 7 (b), depending on-an objective configuration, alpha data can 
be set up more easily. In this case, alpha data will be set up by making the inside 
of a border line into a body field. Moreover, by vacating suitable spacing and 
clicking an objective border-line top one after another, by connecting it smoothly 
by a spline curve etc. in order, using the clicked point as a control point, the 
approach of setting up a border line and setting up alpha data may be used, and 
alpha data can be set up comparatively easily. 

[0040] Furthermore, as shown in drawing 8 , the template of predetermined 
configurations, such as an ellipse, is beforehand prepared in two or more kinds, 
and alpha data can also be set up by arranging them so that the part of a body 
21 may be covered. In the example of drawing 8 , the body 21 is covered with 
four ellipses 22, 23, 24, and 25. The field overflowing from Screen 20 of an 
ellipse is discarded. Fitting is performed by making the sum of these ellipses 22, 
23, 24, and 25 into a body field. As shown in drawing 8 in this case, a body is 
human being's upper half of the body, and if the fitting carbon button 16 is not 
clicked but ** is also made to perform fitting at the moment of having arranged 
the ellipse 22 surrounding a head automatically, arrangement of an ellipse can 
be advanced, checking an objective extract result. 

[0041] Next, when the ellipse 23 has been arranged, for example, fitting is 
performed using an ellipse 23 and the sum of the result and the result of having 



- used the ellipse 22 previously is displayed as a body field. The same is said of 
the case where ellipses- -'24 and 25 are arranged hereafter. Under the present 
circumstances, it traces with the Iwagaki prohibition pen prepared independently 
so that the profile part already set up correctly may not be changed by 
subsequent processing. If the alpha data of the part traced with the overwrite 
prohibition pen are made not to be overwritten, overwriting the profile inputted 
correctly with much trouble of them as as [ Aya ] will be lost. About the part 
traced with the overwrite prohibition pen, it is desirable to color translucent in 
another color so that it may understand at a glance. 

[0042] (alpha-data generation section 7) After the alpha data of the first frame 
are set up in the alpha-data setting section 5 as mentioned above and being 
written in the storage section 3, this the first alpha data and image data of a 
frame are read from the storage section 3, and are sent to the alpha-data 
generation section 5. In the alpha-data generation section 5, the alpha data of 
the frame after two frame are generated by the hybrid method described 
previously, for example. 

[0043] That is, inter-frame motion detection of the image data read from the 
storage section 3 is performed, and the alpha data based on a motion 
compensation are made from deforming about the alpha data of a processed 
frame based on the motion detection result (motion compensation), inter-frame 



[ of the image data read from this, simultaneously the storage section 3 ] - the 
alpha data based on difference are made from difference making a large part a 
body field. And finally the alpha data of the present processing frame are 
generated by choosing the more suitable one of the alpha data based on a 
motion compensation, or the alpha data based on difference accommodative for 
every part of a screen. 

[0044] Sequential generation of the alpha data is carried out for every frame by 
such approach, and it is written in the storage section 3 if needed, and it is read 
from the storage section 3 if needed, and is displayed as an image by the display 
4. 

[0045] (mode setting section 6) In the generation method of alpha data which 
were mentioned above, it does not restrict that the alpha data of all frames are 
correctly generated by once, for example, a body extract goes wrong with some 
frames, and the alpha data which an actual body is large and were far apart may 
be generated. When such, after inputting alpha data again by manual actuation 
using the alpha-data setting section 5 in the frame which failed in the body 
extract, a body extract is done again, and it is made to overwrite the alpha data 
memorized by the storage section 3 of a frame which failed in the body extract. 
[0046] Here, it is set as either mode of overwrite authorization mode and 
overwrite disapproval mode by the user for every frame using the mode setting 



section 6-so that it may not be overwritten in the storage section 3 about the 

> 

alpha data of a frame with which the body field is extracted correctly. 

♦ 

[0047] The setting result by the mode setting section 6 is judged by the control 
section 8, and it is set up by the alpha-data setting section 5 with the frame to 
which overwrite authorization mode was set, or is generated in the alpha-data 
generation section 7, and although the alpha data of the frame concerned 
memorized by the storage section 3 are overwritten under control by the control 
section 8, overwrite is not made with the frame to which overwrite disapproval 
mode was set. 

[0048] Generation of the alpha data based on the automatic extracting of the 
body field in the alpha-data generation section 7 progresses in order of a frame, 
if the frame to which overwrite disapproval mode was set is reached, generation 
of the alpha data of a frame with which the frame is flown and then overwrite 
authorization mode is set up will be performed, or ( drawing 3 ) migration body 
extract processing will be ended there ( drawing 4 ). Moreover, with the frame to 
which overwrite disapproval mode was set, body extract processing may be 
omitted, it may be regarded as that from which the alpha data memorized by the 
storage section 3 were extracted with the frame concerned, and processing may 
be advanced. 

[0049] (other approaches of mode setting) Next, other approaches of the mode 



setting in the mode setting-section 6 are-explained using drawing 9 . Drawing 9 
is an example which performs mode setting on the cine-mode-display lane 11, 
without using the mode setting lane 18 as shown in drawing 2 . That is, as shown 
in drawing 9 (a), an extract initiation pointer and an extract termination pointer 
are set up with directions of a user to the cine-mode-display lane 11, and make 

the frame between these extract initiation pointer and an extract termination 

i 

pointer into overwrite authorization mode, and let the other frame be overwrite 
disapproval mode. If a user clicks the body extract carbon button 17 of drawing 2 
in this condition, a body extract will begin from the frame to which an extract 
initiation pointer points, and a body extract will be completed with the frame to 
which an extract termination pointer points. 

[0050] Drawing 9 (b) is the example which set the extract termination pointer as 
the front frame in time than the frame to which an extract initiation pointer points, 
and a body extract will be performed by the reverse order with the time order of a 
frame in this case. 

[0051] An overwrite authorization initiation frame and an overwrite disapproval 
termination frame may be specified with an extract initiation pointer and an 
extract termination pointer in this way, and a setup in overwrite disapproval 
mode and overwrite authorization mode can be carried out also by specifying an 
overwrite disapproval initiation frame and an overwrite disapproval initiation 



frame. 

[0052] Next, other approaches of the mode setting in the mode setting section 6 
are explained using drawing 10 . In drawing 10 , as 11 A, 11B, and 11C show, 
two or more successive installation law of the cine-mode-display lane 1 1 as 
shown in drawing 2 is carried out, and the result of having performed the body 
extract to coincidence using an extract parameter which is different on each of 
these cine-mode-display lanes 11 A, 11B, and 11C, respectively is displayed. 
[0053] an extract parameter — for example, inter-frame [ the retrieval range of a 
motion vector and inter-frame ] - it is the threshold used in case any of the alpha 
data based on the threshold and motion compensation which are used in case a 
body field or a background region is judged to difference, and the alpha data 
based on difference are chosen accommodative. Although a body field will be 
correctly extracted with a certain frame as stated until now if the value of these 
extract parameter is fixed, an extract may go wrong with another frame. 
[0054] Then, the result of having performed body detection using an extract 
parameter which is different as shown in drawing 10 is put in order and displayed 
on two or more different cine-mode-display lanes 1 1A and 1 1B and 1 1C. A user 
chooses the lane where the body was most correctly extracted for every frame 
among the cine-mode-display lanes 1 1A, 1 1B, and 1 1C, and clicks the image on 
the lane. The selected image is shown by O mark in drawing 10 . 



—[0055] On the other hand, in -order that the property of an -image may seldom 
change with all frames, even when a body extract can be performed in single 
extract parameter value, it may be difficult to find out the optimal extract 
parameter. To this, it is enabling modification of an extract parameter also, for 

^¥xampleln the middle of a body^extract arid how to explore the optimal extract 

parameter can be considered. If an extract parameter is changed by the user, a 

i 

body extract will be made to be performed after the frame using the extract 
parameter after modification. In the 1st body extract, checking an extract result, 
a user changes an extract parameter suitably and explores the optimal value of 
an extract parameter. Since an extract parameter can be changed dynamically 
according to this approach, it is possible to find out the optimal extract parameter 
for a short time. And it can fix to the value of the optimal extract parameter, and 
2nd henceforth can redo the extract of the frame which failed in all frames or an 
extract. 

[0056] (other generation methods of alpha data) Although a motion of a body 
and a background is automatically detected in a hybrid method, if those motions 
are known beforehand, by using the information on the motion direction for an 
alpha-data generate time, throughput can be lessened or improvement in motion 
detection precision can be aimed at. After the alpha-data generation procedure 
shown in drawing 6 applies this idea, runs by step S41 and sets up a parameter, 



this motion parameter is used for it and it is generating alpha data. 
[0057] Drawing 1 1 shows the example as which a user inputs the direction which 
a body moves to such an alpha-data generate time by manual actuation. In the 
phase which shows the image of the first frame, a user drags a body 32 top with 
a mouse, and inputs the motion direction 33 of a body 32. Moreover, since 
panning was in the camera which picturizes a dynamic image, when a 
background 31 moves, the motion direction 34 of a background 31 is inputted 
similarly. 

[0058] If it searches for a motion vector only around the motion which moved on 
the occasion of a body extract rather than it performed motion vector retrieval 
about all the directions, could reduce the throughput for detection to it, and was 
inputted at it when it was made to perform motion vector retrieval only about 
these motion directions 33 and 34 finely, do not increase throughput, it will be 
boiled and more exact motion detection will be attained. Consequently, the 
processing time of a body extract can be shortened or extract precision can be 
raised. 
[0059] 

[Effect of the Invention] Right alpha data can be generated without overwriting 
the alpha data of the frame which already succeeded in the body extract, when 
according to this invention the body in a dynamic image is extracted certainly, 



alpha data- can be generated and it especially performs a body extract with a 
hybrid method etc., as explained above. 



DESCRIPTION OF DRAWINGS 
[Brief Description of the Drawings] 

i 

[Drawing 1] The block diagram showing the outline configuration of the object 
extractor in a dynamic image from the dynamic image concerning 1 operation 
gestalt of this invention 

[Drawing 2] Drawing showing the example of the display screen at the time of 

the object extract in a dynamic image in this operation gestalt 

[Drawing 3] The flow chart which shows the example of processing after 

alpha-data generation of the first frame in this operation gestalt 

[Drawing 4] The flow chart which shows other examples of processing after 

alpha-data generation of the first frame in this operation gestalt 

[Drawing 5] The flow chart which shows the example of processing of the 

alpha-data generation in this operation gestalt 

[Drawing 6] The flow chart which shows other examples of processing of the 
alpha-data generation in this operation gestalt 

[Drawing 7] Drawing explaining the alpha-data setting approach by a setup and 



deformation of a -border line in the alpha-data setting section in this operation 
gestalt 

[Drawing 8] Drawing explaining the alpha-data setting approach using the 
template in the alpha-data setting section in this operation gestalt in this 
operation gestalt 

[Drawing 9] Drawing explaining other examples of the replace mode setting 
approach in the mode setting section in this operation gestalt 
[Drawing 10] Drawing explaining how to generate alpha data using two or more 
different extract parameters in this operation gestalt 

[Drawing 1 1] Drawing explaining how to input the objective motion direction and 
generate alpha data 
[Description of Notations] 

1 — Input section 

2 - CPU 

3 — Storage section 

4 — Display 

5 -- Alpha-data setting section 

6 - Mode setting section 

7 - Alpha-data generation section 

8 - Control section 
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